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Abstract 



We report results of the first search for the pentaquark Pgs which is predicted 
to be a doublet of states: P^^ = \csuud) and P^ = \csddu). A search was 
made for the decay P^g (pirp in data from Fermilab experiment E791, in 
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which 500 GeV/c vr" beam interacted with nuclear targets. We present upper 
limits at 90% confidence level for the ratio of cross section times branching 
fraction of this decay to that for the decay (pn^. The upper limits are 

0.031 and 0.063 for M(PP) = 2.75 and 2.86 GeV/c^, respectively, assuming 
a P£ lifetime of 0.4 ps. 

14.20.Lq, 13.85.Rm 
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Typeset using REVT^ 



The spectrum of observed hadrons fits into multiplets of two- and three-quark states. The 
mass differences within these multiplets can be explained by effective quark masses and the 
color-hyperfine (CH) interaction in the QCD Hamiltonian. Calculations done using the CH 
interaction predict the existence of particles made of more than three quarks. Jaffe pre- 
dicted the existence of the H dibaryon, H = \uuddss), and extensive efforts have been made 
to find it experimentally 0. Lipkin and Gignoux et al. have proposed that a doublet 
of states, the P^^ = \csuud) and the Pg~ = \csddu), and their charge conjugate states, may 
exist and be stable against strong decays. These were named pentaquarks. 

The threshold for strong decay of the pentaquark is 2907 MeV/c^, above which it can decay 
to Df and a nucleon. Calculations done using only the CH interaction predict pentaquark 
masses which vary from 150 MeV/c^ below the D^-nucleon threshold to a few tens of 
MeV/c^ below threshold, depending on how SU (3) flavor symmetry breaking and the mass 
of the charm antiquark are taken into account Contributions to the binding energy 
from other components of the Hamiltonian are even more model dependent. Calculations 
done using an Instanton model 0, bag models [^,|^ and a Skyrme model [|] conclude that, 
depending upon the choice of parameters, the pentaquark is bound or is a near-threshold 
resonance. If bound, the lifetime is expected to be similar to that of charm particles, with 
the exact value depending upon unknown internal structure. In a description of the pen- 
taquark as an off-shell charm meson and a spectator baryon, it is assumed that the off-shell 
meson decays to the same decay products as the free meson. The pentaquark lifetime should 
then be similar to that of the Df charm meson, 0.47 ps. A description of the pentaquark 
as a five-quark state allows more interactions among the quarks and consequently may lead 
to a shorter lifetime. In the work described here, we have considered lifetimes ranging from 
0.1 to 1.0 ps, and pentaquark masses between 2.75 and 2.91 GeV/c^. 

Various mechanisms for pentaquark production have been discussed by H. Lipkin Q. How- 
ever, only crude estimates of the pentaquark production cross-section exist in the litera- 
ture. One mechanism considers a production of all five quarks in the interaction ||10[ and is 
based on an empirically motivated equation which predicts reasonably well the production 
cross-section of other charm particles. Another mechanism is the coalescence model, where 
pentaquark components such as the Df and a nucleon are produced in the reaction and fuse 
into one particle while in overlapping regions of phase-space Typically, the estimated 
pentaquark production cross-section is of the order of 1% that of the Df. 

In this letter we report results from the first search for P^^ production, which was carried out 
in experiment E791 at Fermilab. We measure the product of cross section and branching 
fraction (cr-B) for — > (pup — ^ K~^K~iTp relative to that for Df — > 07r^ —>■ K^K~tt^. 



The E791 experiment |T^ recorded 2 x 10^° events from interactions of a 500 GeV/c vr" 



beam in five thin targets(one platinum, four diamond) separated by gaps of 1.34 to 1.39 cm. 
The trigger included a loose requirement on transverse energy deposited in the calorimeters 
by particles coming from the interaction. Precision vertex and tracking information was 
provided by 23 silicon microstrip detectors (6 upstream of the targets and 17 downstream), 
ten proportional wire-chamber planes (8 upstream, 2 downstream), and 35 drift-chamber 
planes. Momentum was measured using two dipole magnets. Two multicell, threshold 
Cerenkov counters were used for vr, K and p identification. The velocity threshold for light 
emission was different in the two Cerenkov counters, allowing for discrimination of charged 
hadrons in certain momentum ranges. The amount of light collected for each reconstructed 
particle trajectory was compared to that expected for each mass hypothesis for the mea- 
sured momentum. This comparison resulted in a probability estimate for each type of 



charged hadron . Selection criteria based on the probabihty values were used to identify 
the particles. 



We have searched for the pentaquark in its expected decay mode P^^ 07rp, where the 
subsequently decays to K~^K~. We normalize the sensitivity of our search to Df 07r^ 
decays which are similar enough that several systematic errors are common to both decay 
modes and cancel in the measured ratio of cross sections and branching fractions. These are 
convenient decay modes to detect because all decay products are charged, and because the 
narrow (f) signal allows a rejection of K^K~ background. We calculate the acceptance of our 
detector via Monte Carlo simulation. The production of the pentaquark was simulated using 



the PYTHIA particle generator W^. The pentaquark was introduced into the LUND list of 
particles (replacing the and was forced to decay to 07rp — >■ K~^K~'irp. The pentaquark 
was simulated with a lifetime of 0.4 ps and with two different masses, 2.75 and 2.86 GeV/c 
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The first stage of data analysis included reconstruction of tracks and vertices. Events with 
evidence of multiple vertices were kept for further analysis. In the pentaquark analysis, we 
searched for events with four tracks emerging from a decay vertex, consistent with being 
K K 71 p according to information from the Cerenkov counters. It was required that the 
two kaons have opposite charge and that the total charge of the four tracks be zero. The 
invariant mass of the two kaons was required to be within ±5 MeV/c^ of the mass. This 
process selects P£ and candidates with equal sensitivity. Topological, kinematic, and 
other criteria were imposed to reject background and improve the statistical significance 
of a pentaquark signal in the (pirp mass spectrum. To optimize the selection criteria with 
minimum bias, a sensitivity function S/ yBG was defined where S is the number of signal 
events and BG is the number of background events that would pass the selection criterion. 
This function was plotted versus the value of selection criteria applied to the discrimination 
variable of interest (track and vertex goodness of fit, Cerenkov identification probabilities, 
kinematical data, etc.). Two models of signal were used to determine the yield S. One 
was Pg^ generated with the Monte Carlo simulation. The other was the signal from the 
decay of a known particle, present in the data and having certain properties similar to those 
expected for the pentaquark decay. We used the — >• Knim decay to optimize four-prong 
topological criteria. A sample of — K^K~ decays, selected independently from the 07rp 
sample, was used to optimize Cerenkov kaon identification criteria. The number of back- 
ground events, BG, was determined from the 07rp invariant mass spectrum, in a mass region 
outside the 2.75 to 2.91 GeV/c^ range. The maximum in the sensitivity function determined 
the selection criterion for each discrimination variable. By comparing the results using the 
two sources of signal, we selected the criteria such that the sensitivity function was stable 
against small changes in criterion values. When this procedure resulted in a range of ac- 
ceptable criteria, we selected the criterion that yielded the highest efficiency. 

The resulting optimal kaon identification criteria were that each of the two tracks have 
momentum between 6 and 40 GeV/c and a certain minimum Cerenkov identification prob- 
ability. These conditions excluded more than 85% of pions and 60% of protons, while ac- 
cepting about 70% of kaons. The pion Cerenkov identification requirement excluded about 
75% of protons and kaons, while accepting about 70% of pions. The proton identification 
requirement excluded more than 35% of pions, while accepting more than 90% of protons 
and kaons. 



The topological criteria included requirements on the quality of the reconstructed production 
and decay vertices (x^ of the fit), a separation between the vertices of more than lOa^ where 
(j£ is the error in the measured longitudinal separation, and a demand that the momentum 



vector of the candidate pentaquark points back to the production vertex with an impact 
parameter of less than 25 fim. Each of the four decay tracks was required to pass at least 
twice as close to the decay vertex as to the production vertex. In addition, the product of 
the ratios of the distance of closest approach of these tracks to the decay vertex and to the 
production vertex was required to be less than 0.001. The decay vertex had to be isolated 
from its neighboring tracks by at least 10 fim and to be located significantly outside any 
of the target foils. If one of the tracks emerging from the candidate decay vertex pointed 
to another vertex located within one of the downstream targets, it was rejected as possibly 
arising from a secondary interaction. A selection criterion was applied on the sum of the 
squared transverse momenta (p^) of the four tracks, relative to the direction of their summed 
momentum, X^P? >0.5 (GeV/c)^. Since this quantity is determined by the Q value of the 
decay (about 800 MeV/c for the pentaquark) the optimization procedure for Y^pf was done 
using only the signal from the Monte Carlo simulation, which was found to reproduce well 
the distribution of this parameter for known decays. 

Other background reduction criteria included elimination of (pnp vertices that contain either 
A —>■ up candidates or a that points back within 45 fim of the production vertex. Known 
particles decaying to four- prongs with the decay products (mis) identified as two kaons, a 
pion and a proton could appear in the (pnp invariant mass spectrum as a flat background or 
as a broad peak. We identified no known particles that form a peak in the (pirp mass window 
and the only source for flat background due to misidentification of the tracks was from the 
decay —>■ Kix-kti. Candidate KKirp events with a Kmrir invariant mass consistent with 
the mass were removed. Above the appropriate thresholds, candidate (pnp events could 
be due to the combinations (Ac —>■ (j)p) + vr or {Df,D^ — > 4>tt^) + p. No Ac — > 4>p 
candidates were found within the (pnp sample, but three events for which the (pir invariant 
mass is consistent with the Df or masses passed all the analysis cuts. 

In Fig. |l|(a) we show the final (pirp invariant mass spectrum for the optimized analysis cuts. 
The three events which could be described as {Df, (f)^^) + p are shaded. In Fig. |I](b) 

we show the (pwingsT^P invariant mass spectrum, where (pwings refers to K^K~ candidates with 
invariant mass in a range outside the required mass window (between 5 and 10 MeV/c^ 
below and above the mass). This spectrum contains essentially only background events. 
In Fig. |I](c) we show the 07rp invariant mass spectrum with a tighter cut on the proton 
Cerenkov probability, together with a requirement that the track momentum be between 22 
and 75 GeV/c. This selection criterion excludes 95% of pions and more than 80% of kaons. 
It gives essentially the same sensitivity for a pentaquark signal but with half the efficiency. 
In Fig. |I](d) we show the 07r invariant mass spectrum for the Df — >■ 07r^ normalization 
sample. This sample was selected using the same selection criteria (where relevant) as were 
used to select pentaquark candidates. In this manner the systematic error on the ratio of 
efficiencies for the two decay modes was minimized. 

The (pTTp invariant mass spectrum (Fig. |l|(a)) shows a concentration of seven events near 
2.86 GeV/c^ which is absent in the background spectrum of Fig. 0(b). Three of these seven 
events survive the tighter proton Cerenkov selection criterion described above (Fig. |l|(c)), 
consistent with the expected efficiency of this criterion. Only two events outside the con- 
centration survive this requirement. On the other hand, the proton candidate tracks project 
back to the production vertex with an impact parameter distribution different from that 
predicted by the Monte Carlo simulation. For that reason (given the number of events in 
our final sample), we conclude that there is no evidence for P^^ (pnp decays in our data. 



We use the spectrum of Fig. |l](a) to obtain 90% CL. upper limits on the product of the 
pentaquark production cross section and the pentaquark branching fraction to 0vrp, relative 
to that for Df — > 07r^. For a particular </)7rp invariant mass, our limit is: 

where U L{N p^,) is the 90% CL. upper limit on the number of signal events in a mass 
window centered on the invariant mass of interest, given the number of events observed in 
the window and the expected number of background events |jl5|. The quantity iV^ is 
the number of Df — >■ (pir^ decays obtained from the normalization sample (Fig. [^d), and the 
quantities Sp^^^p and Sp, are the detection efficiencies for Pg° — > 07rp and Df 07r^, 
respectively. These efficiencies were calculated from Monte Carlo simulation. The P —>■ (j)7rp 
efficiency depends on the pentaquark mass and for M(Pg°) ~ 2.86 GeV/c^ is approximately 
0.13%. The shape of the background spectrum — for lack of more information — is as- 
sumed to be flat as indicated by Fig. |l|(b). The level of background expected is obtained 
from Fig. ]l|(a) by matching the fiat spectrum to the number of events between 2.4 and 
3.1 GeV/c , excluding the shaded events and the mass region between 2.73 to 2.91 GeV/c^. 

In this paper we present limits for two different pentaquark masses: 2.75 GeV/c^ and 
2.86 GeV/c^. The first value is the lowest mass expected based on the color-hyperfine 
interaction, while the latter value is that at which the largest number of events is observed 
in Fig. 0(a). We consider mass windows of width 40 MeV/c^ which, based on the experi- 
mental resolution, should contain more than 90% of true signal events. 

Table |I| lists the numbers used in Eq. (|1]) and the resultant upper hmits. These limits include 



Such uncertainties 
le distributions of dis- 



a small correction factor fgys to account for systematic uncertainties 
are due mostly to differences between the simulation and data for t 
crimination variables, and their influence on the ratio £p^^.j,p/£D -*4>-k- The total systematic 
error is 19% for M(P° )=2.75 GeV/c^, and 16% for M(P°J=2.86'GeV/c2. These errors give 
rise to correction factors /cy5=1.06 and /5y5=1.07, respectively. Assuming the branching 
fractions of the Df (f)7i and P^^ (pnp decays are similar, the resulting upper-limits 
approach the range of the theoretically estimated ratio between the pentaquark and Df 
production cross sections ||lO| , p!I[| . 



TABLES 





2.75 GeV/c2 


2.86 GeV/c2 




3.4 


11.0 




0.38±0.07 


0.62±0.09 




293±18 


90% C.L. 






upper-limit 


0.031 


0.063 



TABLE L Values of UL{Np_^^p), ratio of efficiencies for P (j)TTp and Dg — > ^tt, and 
Npi^^^T^ used to calculate the upper limit on the ratio of cross section times branching fraction for 
the decays P° — > (pirp and Df as defined in Eq. (1). Two values of pentaquark mass are 

used. The pentaquark lifetime used to calculate efficiencies is 0.4 ps. 



The value of the upper-limit depends upon the pentaquark lifetime due to dependence of 
the acceptance on lifetime. The upper-limit is a rapidly decreasing function of lifetime, from 
an upper- limit close to 1 for 0.1 ps, to the value listed in the table for 0.4 ps, and remaining 
about the same for larger lifetime values. 

In summary, we present results of the first search for the pentaquark particle. We see no 
convincing evidence for pentaquarks decaying to (f)7ip in our data. Upper-limits are pre- 
sented for the ratio of a ■ B for P^^ dnp and Df 07r^, for two different values of 
pentaquark mass. The upper-limits are approaching the theoretically estimated ratio of 
production cross-sections if we assume the same branching fraction for the two decays and 
a pentaquark lifetime of 0.4 ps or greater. 
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FIG. 1. (a) The (pirp invariant mass spectrum from the E791 data for the optimized selection 
criteria. Events in which the (pir invariant mass is consistent with the or masses are shaded, 
(b) Spectrum of 4>wingsT^P for the optimized selection criteria; see text for a full description, (c) The 
same spectrum as in (a) , with a tighter proton identification criterion, (d) 07r invariant mass spec- 
tnmi showing the Df normalization sample. The left-most peak arises from Cabibbo-suppressed 
decays. 
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